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THE CAPACITY FOR THE LINEAR TIME-INVARIANT GAUSSIAN RELAY CHANNEL 
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ABSTRACT 

In this paper, the Gaussian relay channel with linear time-invariant relay 
filtering is considered. Based on spectral theory for stationary processes, 
the maximum achievable rate for this subclass of linear Gaussian relay 
operation is obtained in finite-letter characterization. The maximum rate 
can be achieved by dividing the overall frequency band into at most eight 
subbands and by making the relay behave as an instantaneous amplify-and- 
forward relay at each subband. Numerical results are provided to evaluate 
the performance of LTI relaying. 

Index Terms- Linear Gaussian relay channel, linear time-invariant filter- 
ing, Toeplitz distribution theorem, maximum achievable rate 

1. INTRODUCTION 

The relay channel problem is one of the classical problems in informa- 
tion theory, and still the capacity of this three node network is not exactly 
known. However, many ingenious coding strategies including decode- 
and-forward, compress-and-forward, etc. beyond the simple instantaneous 
amplify-and-forward (lAF) scheme have been developed flU). Recently, 
El Gamal et al. proposed a more advanced Hnear scheme for relay chan- 
nels based on linear processing at the relay to compromise the complexity 
and performance between the complicated coding strategies and lAF (3), 
and showed that the scheme could peiform well in certain cases by giving 
an example. Although the capacity for frequency-division linear relaying 
was obtained in their work, the general linear relay case was not explored 
fully, and the capacity for the general linear relay channel is not still avail- 
able; the general linear problem becomes a sequence of non-convex opti- 
mization problems and seemingly intractable (3) except the simple case of 
one-tap lAF (4). To circumvent such difficulty, in (5j we considered more 
tractable and practical Hnear time-invariant (LTI) relaying, and proposed 
an efficient joint design algoiithm for source and relay filters for general 
inter-symbol interference (ISI) relay channels. However, a performance 
bound for the LTI relaying was not obtained. In this paper, we derive the 
maximum achievable rate of LTI relaying in finite-letter characterization, 
based on the technique in [3] and results from spectral theory 0{8]. The 
obtained result provides new insights into the structure and performance of 
optimal linear relay processing. 

Notations: We will make use of standard notational conventions. Vectors 
and matrices are written in boldface with matrices in capitals. All vectors 
are column vectors. For a scalar a, a* denotes its complex conjugate. For a 
matrix A, A-^, A^ and tr(A) indicate the transpose, Hermitian transpose 
and trace of A, respectively. In stands for the identity matrix of size n 
(the subscript is omitted when unnecessary). The notation x ~ J^ifJ-, S) 
means that x is Gaussian distributed with mean vector fj, and covariance 
matrix S. E{-} denotes the expectation. M and C are the sets of reals and 
complex numbers, respectively, t = \/— T. 

2. SYSTEM MODEL AND BACKGROUND 

We consider the general additive white Gaussian noise ( AWGN) relay chan- 
nel in Fig. [T] Here, Xs is the transmitted symbol at the source; Xr and yr 
are the transmitted and received symbols at the relay, respectively; and j/^j 

^The authors are with Dept. of Electrical Engineering, KAIST, South Korea. 
Email:{ysung@ee and lighid@stein}.kaist.ac.kr. This research was supported by 
Basic Science Research Program through the NRF of Korea funded by the Ministry 
of Education, Science and Technology (2010-0021269). 



Wr 




Fig. 1. System model 



is the received symbol at the destination. We assume that the channel co- 
efficients from the source to the destination, from the source to the relay 
and from the relay to the destination are 1, a and b, respectively. Then, 
the received signals at the relay and destination at the i-th symbol time are 
given by 

yr[i] = axs[i] + Wr[i], and 
Vd [i] = Xs [i] + bxr [i] + [i] , 

respectively, where uis[j] and Wr[i] are independent and both are from 
Af(0, cr'^). The source and relay have maximum available power P and 
7P, respectively, for some 7 > 0. 

Here, we introduce the Toeplitz distribution theorem for our later de- 
velopment. 

Theorem 1 Let {r^ := E{iy„2y*_j,}} be an absolutely summable 
autocovariance sequence of a stationary process {yn}: letH^ = [r^_j]^j 
be its Toeplitz covariance matrix; let fy (u)) := 2V Efc=— 00 
the spectrum of{yn}; and let {Ci"^} the eigenvalues of 12^. Then, 

lim -^g(C"') = — / g{fy{co))d.o (1) 

n^oo n ^ — ' 27r Jn 

I— 1 

for any continuous fimction g{-). 

3. LINEAR TIME-INVARIANT RELAYING 
3.1. General LTI relaying 

The general (possibly noncausal) linear processing at the relay is given by 

j 

for arbitrary linear combination coefficients hij . However, such linear pro- 
cessing requires time- varying filtering at the relay and is not readily realiz- 
able. Thus, in this paper we restrict ourselves to the case of LTI filtering at 
the relay. In this case, the relay output is given by 

^r[i\ = "^hjyrli- j], (2) 
J 

where [■ • ■ , h_i , /iqi '^i: '^21 ■ ■ ■ ] is the (possibly noncausal) LTI impulse 
response of the relay filter which is assumed to be stable, i.e., X]j=^oo I 
< 00. Thus, the frequency response H(u)) of the relay filter is well defined 
as H{bj) = (l/27r) X]j1L— 00 h,je~''^" . Note that the frequency response 



H{lo) is complex in general since {hj} is arbitrary except being stable. 
^2) can be written in vector form as 



where 



and 
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With the LTI filtering relay, the overall channel from the source to the des- 
tination becomes a Gaussian ISI channel, and stationary Gaussian input 
distribution is sufficient to achieve the capacity (5] pp. 407-430]. Thus, we 
assume stationary Gaussian input distribution hereafter: 

= [xs[l],xs[2],--- ,xs[n]f r.MiO,-E'J, 

where Sfj is Hermitian and Toeplitz by the stationary of the input process. 
Then, the power constraints for the source and relay are respectively given 
by 



< nP, 



and 



E{tr(H„y;(H„y;)«)} = tr{H„(a2E= 4- aH)Hi^ ) < n-yP. 
The received signal vector at the destination is given by 



(3) 



■ = (I + abH„)x^ + bH„w; + 



where yj^ = ■ ■ ■ , J/dM]"^ and w™ ~ A/'(0, cr^I) for m = r,d. 

The transmission rate in this case is given by ^/(xj^; yjj) 

J_ I (I + afeH„ )S° (J + abUn)" + ct^(J + b^HnH^)| 
2^ °^ |(T2{I + fe2H„Hf)| ' 



1 

2n 



log I ^ 



■,H\ 



(4) 



where G„ = a^'^ {I+b'^HnH^l^ )^'^^^ (l+abHn). Thus, the maximum 
rate with LTI relaying for block size n is given by maximizing the mutual 
information (4) over and U„ under the power constraints (3ji the 
capacity with LTI relaying is given by its limit 



Cl 



lim sup 



1 



(5) 



as n -4- oo, if the limit exists (5]. The capacity expression in (5) has 
infinite-letter characterization. In the next section, we will derive an ex- 
pression for the maximum achievable rate in this LTI relaying case infinite- 
letter characterization, based on a similar technique to that used in (3] and 
the Toeplitz distribution theorem. 

3.2. The capacity for LTI relaying 

First, let SJ^ denote the covariance matrix of the noise-whitened output 
symbol vector at the destination in @, i.e.. 



and let {C^"' ,i = l,---,n}be the eigenvalues of SJ^. The spectrum of 
the noise-whitened output process at the destination is simply given by 1101 



(6) 



where f" (uj) is the input spectrum and H{u)) is the frequency response of 
the relay filter. Also, the spectrum of the relay output is given by 



r{u) = (a^r(u) + a^)\H{uj) 



(7) 



Let the n uniform samples of f^iui) and those of f^{io) over ui £ [0, 2-k) 
1, ■ ■ ■ , n} and i * = 1; ' ' ' i "}> respectively, i.e.. 



be Id"' 



By (6) and (7) we have 



(n) 
r.i 



ij = {27r{i-l)/n)- 



1 



|1- 



(n) 



f72(l+62|A^"'|2) 



„{") 



(8) 



(9) 



for i = 1, ■ ■ ■ ,n, where {/i'"'} and {a'"'} are the n uniform samples 
of the input spectrum f"{ui) and those of the frequency response H{uj) of 

the relay filter, respectively, over u 6 [0,27r). Note that {^J.'f^} are real 

and {a'"^} are complex. (Hereafter, we will omit the superscript (n) for 
notational simplicity.) Then, we have 



1 



n 



(10) 



OO, since 



for some €„ J, as n - 

|i/(x^;y^') - log{f''{uj))duj+ 1- f^' logif {u))duj 

\n iiT Jo 4ir Jo 

^ X^log^d,,! < |i7(x^yj) - -1 \ogif''iu))dJ 
II" 4ir ./o I 



2n 



\^ /'"'log(/''(a;))da;- -l-^logC^,J < e„ 
I 4ir Ja 2n ^ \ 



(II) 

The first inequality is obtained by the triangle inequality. The first term in 
the right-handed side (RHS) of the first inequality in jilt decays to zero by 
Theorem[I]becau.se/(xJ;y;j) = (l/2)log|S^| = (1/2) log Cd,., 
f{x) = log X is continuous over x > and the eigenvalues of is away 
from zero due to the added identity matrix. The second term in the RHS of 
the first inequality in jilt also decays to zero since ^ 51]"= i log^d.i is 
the Riemann sum for the integral J^^ \og{f'^{uj))duj; it converges for 
any almost-surely continuous spectrum f^iuj) over the domain [0, 27r). 
(Note that f''{uj) > 1, V w S [0,27r). See j6).) {To} implies (l2\ . 
Similarly, the powers at the source and relay are respectively given in terms 
of {^i, AJ by 



and 



tr(H„(a2s^ + a2l)H^ ) - 5^(aV« + 



(13) 



(14) 



for some t'^ \. and ej^ 4, as n — > oo. By )12ll3ll4l , for sufficiently 
large n, the maximum rate for LTI relaying with n channel uses is given 
by 



1 " 

max — N 1 

{m.},{a,} 2n^ 



1 + 



^^i \l + ab\i\'^ 



(15) 



with slight abuse of the notation it, subject to the constraints J^ILi A** S: 
<P - E?=i(«V» + ^^)|A>P < n-yiP - e^) and > for 
i = 1, • • • , n. 

Now let us derive lim„_>cxD Ri/j'jiP)"/P)- To derive a finite-letter 
expression for the limit, we follow the technique used to obtain the capacity 
for the frequency-division linear relay channel by El Gamal et al. (3). First, 
suppose that there exists no £ {1, 2, ■ ■ ■ , n} such that Ai = ■ ■ ■ = 
Ano = and assume that /li > and \i for i > no without 
loss of optimality. Let So S [0, 1] be the portion of the total source power 
n(P-e^) usedby /^l, ■ ■ ■ , /x„g . Then, Mi = 6on{P-e'^) andthe 

relay does not allocate any power to these bins out of the total relay power 
n/y(P — eJJ). Thus, each bin is a point-to-point channel with the same 



ab\i\ 



1 1 " / 



fii \1 + abXi 



+ En 



(12) 



channel coefficient, and hence the optimal source power allocation is m = 

^""^tTq ""^ * ~ li ■ ■ ■ : '^0- For global optimality the Karush-Kuhn- 
Tucker (KKT) condition should be satisfied for the remaining variables 
{fii, Ai, j = no + 1, ■ ■ ■ , nj. For the problem )15t the Lagrangian and 
KKT condition are respectively given by 



subject to Tj , 9j > 0, the mode combination constraint Ylj—o "0 ~ 
the power distribution constraint j=o ~ ^- '""^ relay power con- 
straint Y,%i -r^i? {a^ 8 j P / Tj + a'^) = -yP. Here, t = [ro.n, 



,6»49] e RS'', A= [Ai,A2,--- ,A49] 



£ = 



and 



1 

2n 



^ log I 1 

= "0 + 1 



1 + ah\iY 
1 + 6"|A.|2 



+ a \ n{P - 



(16) 



- A'i ) +/3(«7(P- 

i = "0 + l 



i = "0 + l 



dC/dfii = dC/dXi =0, « = no + 1, ■ 



(17) 



where d/dfii is the ordinary real derivative and d/dXi is the com plex 
derivative defined by Brandwood j U j . Here, each partial derivative in U7t 



is a joint function of and A;. From 
terms of A^ by 



0, optimal fii is given in 



_ |1 + abAil-^ - 2ncr^(Q + 0a^|Ai|'^)(l + b-'IAil^) 
~ 2n(a + d^l3\^)\l + atAiP ' 

By substituting jiS) into C, taking the complex derivative of C w.r.t. Ai, 
and performing some manipulation, = is expressed as a system of 
two hivariate polynomial equations with degree seven: 



7 k 

E E € 

fc=0 !fc=U 



(fc) fc-i,. i,. 



: and 



(19) 

where Xi and are the real and imaginary parts of A;, respectively, i.e., 



\i = Xi + LVi, and cf''^ and d)"' are independent of the bin index i. (The 
two equations in (19) are from the real and imaginary parts of dC / dXi = 
0.) Here, we have two variables {xi,yi) and two nonidentical bivariate 
polynomial equations. By Bezout's theorem [121 , the maximum number 
of solutions to )19t is the product of the degrees of the two polynomials. 
Thus, in our case the maximum is 49 = 7 X 7, and optimal A; = + (,)/; 
satisfying the KKT condition is one of the solutions {Ai, ■ ■ ■ , A49} to 
U9K regardless of i. (If the number of solutions is less than 49, then some 
of Aj are the same.) Due to this fact, the computation of R^^^j (P, "/P) in 

(H) requires only a finite number of modes. Let rij, j = 1, - ■ ■ , 49, be the for real a and b. subject to tj , 0j > 0, J=o '''j — 1- EI=o = ^' '^'"^ 



••• ,T49] e m5o_ = [eg^e^ 

e C49, andCix) = i log(l + x). 



Proof. Substitute (20) into 115) , and take limit as n — > 00. Then, we have 
en, eji, ej( — > 0, lim„_>oo = and the limit of 115) is f2\\ . (Con- 
verse) The achievable rate cannot be larger than 12 It because the maximum 
number of modes except mode is 49 by Bezout's theorem. (Achievahility) 
Suppose that we have obtained {tj, 9j, Aj} from the optimization )2U . 
Shortly, we will see that the above rate can be obtained by partitioning the 
overall frequency band into 50 subbands and by using lAF with gain Aj 
at subband j. This can be accomplished by using a filter bank of 50 ideal 
band-pass filters (one for each subband and gain Aj for subband j). The 
impulse response of this filter bank is the sum of the inverse DTFTs of the 
frequency responses of the subband filters, and is stable. ■ 

Remar k 1 ( ;) When the number of solutions to )19t ('.v less than 49, 
(21) is still valid. Solving i2l\ will yield the same result as solving 
a possible further-reduced optimizati on p roblem in this case. This 
is like that solving the size n problem (15) directly should yield the 
same result as solving the reduced-size problem with the cost (20) 
when the number of solutions is exactly 49. )2U has already finite- 
letter characterization, but the number of the required modes can 
be reduced further by considering the structure of the optimization 
12 It . See Corollary\l\ 

(ii) Since the bins here are frequency bins, a mode is a frequency sub- 
band. 

(Hi) Since causal and stable LTI filters are contained in the set of the 
considered stable and possibly noncausal filters, )2U is an upper 
bound on the capacity of the causal LTI Gaussian relay channel. 

Corollary 1 The capacity for the linear Gaussian relay channel with pos- 
sibly noncausal LTI relaying is given by Clti {P, fP) = 



max roC + r,C M- • ^ ■ 



P (1 + afeA,)^ , 

^ 1 (22) 



■fe2A? 



number of occurrence of Aj out of n — no bins (no + ni + ■ ■ ■ + n49 = n). 
Then, the objective function for maximization in )15t is given by 



ELi^-jAf {a'^djP/Tj+a'-^) = 7P. Here, t = [ro.n, ■■■ .ry] £ 



2n 



2n 



noo-^ 



(20) 



C{x) = ilog{l + x). 



[Ai.Aa,--- .Ay] 6 



and 



"i log ( 1 



ejn{P-e'„) |l + afeAjf 



1 



where 9j is the portion of the total power allocated to mode j, (80 + • • • + 
S49 = 1). Based on the above, we now have the capacity for the Gaussian 
relay channel with LTI relaying, given in the following theorem. 

Theorem 2 The capacity for the linear Gaussian relay channel with pos- 
sibly noncausal LTI relaying is given by 



Clti{P,iP) 



max roC 

T,e.\ 

49 



dpp 

roo-2 



P \l + ab\j\'^ 



(21) 



Proof: To maximize the argument, |1 + a6Aj|2/(l -\- b'^\\j\'^) m C{-) 
in j2H , Aj should be aligned with the complex conjugate of ah under the 
same magnitude. Hence, optimal A; is real, and we can peiform the opti- 
mization only over real A^ without loss of optimality. The same procedure 
as before can be performed except that {A^} are now real and that dC/dXi 
is the ordinary real derivative. In this case. A; is a solution of a fixed 7th 
order univariate polynomial equation, 5I]I=o ~ ("^7 7^ 0)' regard- 
less of i. So, we only need at most seven real Aj 's. (In the case that a and b 
are complex, still the phase of optimal Aj is fixed and only the magnitude 
is a single real variable. Thus, we have the same result of at most seven 
different solutions.) ■ 
Note that the degree of freedom in real A^ is halved compared with the 
complex Ai case, and the maximum number of solutions to the correspond- 
ing KKT conditions is the square-root of that in the complex A; case. Real 
Ai (or equivalently real H{u])) implies noncausal symmetry of the relay 



filter (i.e., /i_ 



1, 2, ■ ■ ■ ). The class of symmetric LTI filters 



include ideal low-pass filters, raised-cosine type filters, linear-phase filters 
with symmetric coefficients, etc. 

In (3), El Gamal et al. obtained the capacity formula for the frequency- 
division (FD) hnear Gaussian relay channel, given by 



max Tq C 



(23) 



E 



1 + 



Vj 



where t^'^ 
subject to r; 



fd 



fd f,fd 

j ' 



J 



4 ^fd _ 

2' 



fd 



Vj > 0, E 



E 



j=0 



,fd ^ 
j 



4 

i=i 

■yP. One simple difference of the LTI 



1 + b'^Vj 
1, and E 



relay from the FD relay is the maximum number of subbands (or modes) 
required to achieve the capacity. A more important difference lies in the 
difference in the operation at each frequency subband. In the LTI relay 
case, the effective signal-to-noise ratio (SNR) at subband j in 122 1 is given 
by 

P (1,^^... (24) 



1 



-b^-Xj 



This is exactly the effective SNR of the relay channel equipped with lAF 
with gain Xj. ( i24i is easily obtained by considering that the signals along 
the two paths in Fig. [T]are added before reaching the destination.) Thus, 
Corollary[T]states that a capacity-achieving strategy is to divide the overall 
frequency band into at most eight subbands and to make the relay behave 
as an lAF relay with gain Xj at subband j . In the FD relay, on the other 
hand, the effective SNR in C(-) in )23t is given by 



P 

7^ 



Vj 



1 + fe2»7j 

for subband j. Here, let us consider the following data model: 



yd,i 
yd,2 



1 



bXjWr + -UJd,! 



(25) 



(26) 



where Xs ~ A^(0, P) and w^ i, Wd ^i f r ' A^(0, o"^). Note that the 
data model {26\ con'esponds to the FD relay channel in which the relay is 
lAF with gain Xj . The SNR after optimal matched filtering for the received 
signal in j26t is given by 



(27) 



which is exactly the same as (25) with substitution rjj = X^ . Hence, (23) 
states that a capacity-achieving strategy in the linear FD relay is to divide 
the overall frequency band into at most five subbands and to use lAF at 
each subband. In both cases, an optimal strategy achieving the capacity 
is to divide the overall frequency band into a finite number of subbands 
and to use lAF at each subband! Surpiisingly, infinite frequency segmen- 
tation is not required. The optimality of this finite frequency segmentation 
comes from the fact that the channel is flat-fading and thus each term in 
the Lagrangian C in has the same form. In the ISI channel case, the 
frequency-domain channel coefficients a and b depend on the bin index i. 
(We should use and bi instead of a and b.) Hence, the solution {iii, Xi) 
to dC/dp.i = and dC/dXi = can be different for alH S {!,■■■ , n}. 
Thus, in the ISI case, the optimahty of finite frequency segmentation is not 
guaranteed any more, and the capacity has infinite-letter characterization. 

4. NUMERICAL RESULTS 

We now provide some numeiical results. (22) was evaluated by using a 
commercial optimization tool. 0211 and (22) resulted in the same value.) 
Fig. |2]show the rates of several schemes. Since the performance of other 
schemes is available in (5], we only considered the unlimited look-ahead 
cut-set bound, lAF and LTI relaying. Fig. [2] (a) show the performance in 
the case of a = 1, b = 2 and 7 = 1. In this case, it is known that the 



lAF already performs well and achieves the capacity when P > 1/3 (4). 
The LTI relaying improves the performance over the lAF at the very low 
SNR values, but the gain is not significant. Fig. [2](b) show the peifor- 
mance in the case of a = 2, b = 1 and 7 = 1 in which the lAF has 
noticeable performance degradation from the cut-set bound. Even in this 
case, the gain by general LTI filtering over the lAF is not so significant. 
Thus, lAF seems quite sufficient for the general single-input single-output 
(SISO) flat-fading^ielay channel when lineal' filtering is considered for the 
relay function. 

S. CONCLUSION 

We have considered the LTI Gaussian relay channel. By using the Toeplitz 
distribution theorem and the technique in (3|, we have obtained the capac- 
ity for LTI relaying in finite-letter characterization, and have shown that 
the capacity can be achieved by dividing the overall frequency band into at 
most eight subbands and by using lAF with possibly different gain in each 
subband. Thus, an optimal LTI relay can easily be implemented by using a 
filter bank. 
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(b) a = 2, 6 = 1 
Fig. 2. Performance of symmetric LTI relaying 
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